Apparatus and method for collection of protocol adherence data

ABSTRACT

A data capture and storage apparatus for use in confirming administration of medication in a clinical trial or other medication administration scenario is provided. The apparatus includes a data capture device for capturing one or more types of data related to administration of a medication, a storage device for storing the captured data and a processor for processing the stored captured data. The processor further includes an analysis element for performing a local analysis of the stored captured data. The processor is further adapted to identify a particular medication prescription regimen in accordance with the clinical trial or medication administration scenario, determine one or more procedures for administering such prescription regimen, identify one or more activity sequences associated with such procedures, capture activity sequences of actual administration of such prescription regimen compare the captured activity sequences to the identified activity sequences to determine differences therebetween, and providing a notice if differences are determined.

This application is a continuation, and claims priority, of co-pendingU.S. application Ser. No. 12/728,721, filed Mar. 22, 2010. The contentof the prior application is incorporated herein by reference in itsentirety.

FIELD OF THE INVENTION

This invention relates generally to patient compliance in clinical drugtrials or other medication administration protocol scenarios, and moreparticularly to an apparatus for the collection, analysis andtransmission of data related to monitoring, instruction and interventionof patients in clinical trials or other medication administrationprotocol scenarios in order to improve adherence with prescribed drugprotocols in accordance therewith.

BACKGROUND OF THE INVENTION

Dr Lars Osterberg, M.D. and Dr, Terence Blaschke have reported in theNew England Journal of Medicine, Adherence to Medication, (N Engl J Med2005; 353:487-97) 2005 an alarming lack of adherence to requiredmedication protocol, further noting that while the average rates ofadherence in clinical trials is categorized as “high”, this number stillcomprises only rates of 43 to 78 percent. Most importantly, the authorsnote “The ability of physicians to recognize nonadherence is poor, andinterventions to improve adherence have had mixed results.” Adherence,p. 487. The authors conclude “Poor adherence to medication regimens iscommon, contributing to substantial worsening of disease, death andincreased healthcare costs.” Adherence, p. 494. The Trend Repot Series,2008 Patient Adherence Update: New Approaches for Success, October 2008,report similar discouraging statistics. This broad range may possiblycontribute to the public confidence in the FDA approval process and theimportance of continued surveillance of a drug throughout the process.Furthermore, it may help to explain why, according to the Journal of theAmerican Medical Association (JAMA May 1, 2002), one out of every fivenew drugs that comes to market in the US is found to have serious orlife-threatening adverse effects—unknown or undisclosed at the time ofapproval. It is against this backdrop of poor adherence, and potentialdanger to patients, that the present invention operates.

It has been widely recognized that methods and systems for insuringproper medication ingestion or administration by individuals are veryimportant in defending against unnecessary sickness, deaths and otherproblems. Giving instructions and then letting patients fend forthemselves has been shown not to work particularly well. This is becauseit is not only the improper ingestion of medicines that is the primarycause of medical danger. Rather, an overall lack of sufficient patientguidance is also part of the problem. Further, the inability to confirma proper prescription regimen being provided to a user in the firstplace may cause a number of other problems with the use of suchmedication.

Traditionally, participants attend introductions and follow ups forclinical trials in-person. Other patients attempting to adhere to aparticular medication protocol similarly are given a prescription and aparticular set of instructions from a prescribing medical provided orprescribing doctor, and then compliance is measured at a next visit withthat prescribing professional. Thus, data collection is similarlylimited to patient visits, rather than on a daily basis. Old methodssuch as patient questioning and pill counting have been proven to beinadequate measures of adherence and offer no information on dose timingand drug holidays (omission of medication for three or more sequentialdays).

Compliance technologies can increase the statistical power of clinicaltrials. Through the use of such technology, clinical events can beprecisely linked to medication use history. Captured data can be linkedto other sources such as EDC, patient diaries and data collected by thephysician. Technologies can create many possibilities for remote visitsand data capture. While smart packaging technologies exist such asRFID-enabled computer chip technology, smart blister packs and MEMS caps(microprocessor in a bottle cap), they are: a) invasive and need to bephysically attached to the medications; b) are non-conclusive regardingcompliance—a patient may activate the technology without ingestion ofthe medication; c) remain largely unadopted in clinical trials by thepharmaceutical and biotech companies due to their high cost; and d) takea longer time to implement. Further, electronic patient diaries allowfor ease of entry of data by a patient. These diaries, however, arestill subject to issues related to compliance with medication adherence.Thus, even if a patient is meticulous about entering information intothe diary, and thus complying with the requirements for data entry,there is still no guarantee that they are properly taking medication atprescribed times.

Jo Carol et al. stated that “The most reliable method for researchpurposes, although not practical in a clinical setting, may be acombination approach that includes pill counts, patient self-report, andelectronic monitoring.” (Carol J. et al, Patterns to AntiretroviralMedication, The Value of Electronic Monitoring, AIDS, 17 (12), pp 1,763-767, October 2003. To date, technologies alone have only been usedto monitor compliance rather than to encourage it. Furthermore, therehas been no comprehensive system provided that allows for the managementof multiple patients and multiple patient populations. While currenttechnology may allow poor compliers to be recognized, as will bedescribed below, the proposed apparatus and method of the presentinvention will help to encourage pharmaceutical compliance and tacklesome of the problems that are encountered in the clinical trial processin particular, and the medication protocol monitoring problem ingeneral.

A number of systems exist that provide instructions to a user regardingwhen to take a medication and records when the user indicates that amedication has been taken. U.S. Pat. No. 7,359,214 describes such asystem. A device is provided that provides instruction to a patientregarding medications to take. Furthermore, the system may provide amethod for determining that the prescription is appropriate given thepatient's conditions, and other medications he or she may already betaking. The system may monitor the dispensing of medicine in accordancewith a predetermined treatment protocol. While such a system providesmany improvements for easing a burden on the patient, this systemsuffers in many ways and in particular in ways relevant to theadministration of clinical trials and other active patient monitoring ofmedication adherence.

Most importantly, this system provides no mechanism for actuallyconfirming that a patient is in fact ingesting or otherwise properlyadministering required medication as required in a clinical drug trial,or as prescribed by a prescribing physician in the case where adherenceto a particular regimen may prove to be critical to efficacy of theprescription regimen. Further, while the system may be sufficient forone who is in full possession of their mental faculties, any individualwho may have difficulty following directions, or one who is activelyavoiding medication may still not be taking required medication after itis dispensed. Thus, participants may be forgetful, visually impaired, orotherwise do not believe in the benefit of taking such medication, andmay thus not properly log medication administration. Furthermore, thesystem requires preloading of various medications into a dispenser, andthus likely requires regular visits by an administering manager to besure appropriate medications are in fact properly loaded therein. It issurely possible that an inexperienced user may place incorrectmedications into the device, or may somehow provide incorrect dosagesinto the device. Additionally, for potentially more complex regimens,there is no method provided for insuring that a user is able to followsuch a protocol, and to thereafter confirm that the user has in facttaken all required medications in accordance with any providedinstructions or the like, or has taken the medications according to oneor more specifications or followed suggested procedures. Finally, thissystem is expensive and requires constant maintenance to confirm thatthe various mechanical parts are in working order.

U.S. patent application Ser. No. 11/839,723, filed Aug. 16, 2007, titledMobile Wireless Medication Management System provides a medicationmanagement system employing mobile devices and an imaging technology sothat a user is able to show a pill to be taken to the system, and thesystem can then identify the medication. Patient histories are availableto an administrator, including various vital signs as measured by thesystem. Images may also be taken of the patient, provider, medicationcontainer or the like. While the system professes to ensure adherence toa protocol, the system only provides such help if requested by a user.There is in fact no particular manner in which to ensure actualadherence or the relationship of adherence to the efficacy of the drugover time. When requiring adherence to a predetermined protocol for aclinical trial, this is particularly relevant.

Additionally, existing systems fail to maintain an audit trail for postadministration review by a medical official or other clinical trialadministrator, and further cannot therefore confirm confirmation ofproper medication administration.

Therefore, it would be desirable to provide an apparatus that overcomesthe drawbacks of the prior art.

SUMMARY OF THE INVENTION

In U.S. patent application Ser. No. 12/620,686, filed Nov. 18, 2009,titled Method and Apparatus for Verification of MedicationAdministration Adherence; currently pending, U.S. patent applicationSer. No. 12/646,383, filed Dec. 23, 2009, titled Method and Apparatusfor Verification of Clinical Trial Adherence, currently pending; andU.S. patent application Ser. No. 12/646,603, filed Dec. 23, 2009, titledMethod and Apparatus for Management of Clinical Trials, currentlypending, the contents of these three applications being incorporatedherein by reference, the inventors of the present invention haveproposed a system and method that allow for complete control andverification of adherence to a prescribed medication protocol or machineor apparatus use in a clinical trial setting, whether in a health careprovider's care, or when self administered in a homecare situation by apatient.

These applications present the only medication management system thatmay determine whether a user is actually following a protocol, provideadditional assistance to a user, starting with instructions, videoinstructions, and the like, and moving up to contact from a medicationadministrator if it is determined that the user would need suchassistance in any medical adherence situation, including clinical trialsettings, home care settings, healthcare administration locations, suchas nursing homes, clinics, hospitals and the like, and in clinical trialsettings.

In accordance with the present invention, an apparatus is provided thatfacilitates information presentation to a patient, information captureof medication administration at home in a homecare setting, in ahospital setting, in a clinical trial setting, or in any other settingin which medication adherence is potentially an issue, and other aspectsdescribed as part of the method and system of the pending applicationsnoted above. Therefore, in accordance with the present invention, avideo capture device is provided including a memory for storing capturedvideo and other patient data, analyzing such captured data, transmittingsuch captured data to a remote location, receiving information from aremote location and providing information to the patient as preferred inaccordance with the present invention. In accordance with a preferredembodiment of the invention, an apparatus is provided comprising a videocapture device, an audio capture device, memory for storing suchcaptured data, a processor adapted to operate analysis software foranalyzing the captured data, a transmitter for transmitting the captureddata, or other versions of the data or analysis results to a remotelocation, for receiving data and further instructions or communicationfrom the remote location, and a display for providing such data orfurther instructions to the patient. Such apparatus may preferablyinterface with management software adapted to manage multiple patients,and thereby providing a full monitoring and data collection procedure.

The novel combination of text, graphical, pictorial, and video presentedin accordance with the present, and as further described in the abovenoted applications allows the compliance problem within clinical trialsand other patient monitoring of adherence to medication protocols to betackled in a holistic manner. The present invention provides anapparatus that presents a number of solutions. The apparatus preferablymay provide step-by-step image and video instructions to the user orcare provider on how to administer medication, what the side effects ofthe medication are and the benefits that have been found. This avoidsmisunderstandings resulting from prescribing instructions and may allowan approach that may be utilized internationally, thus overcomingpossible language barrier issues and the like.

A specific medication regimen may be programmed into a medicationcalendar included within the apparatus constructed in accordance withthe invention to alert the user when medication should be taken andprovide clear video instruction for taking the medication. Thesereminders minimize forgetfulness by the subject in clinical trials orwhen administering medication in a typical home setting, and help thelogistical challenges involved in complex medication regimen such asdouble blind studies, for example. Furthermore, the medication calendarand the compliance results are accessible to the clinical trialorganizers.

Once an alert is provided by the apparatus of the invention and thepatient has confirmed that they are ready to take the medication, theapparatus is adapted to record the type of medication and quantitythrough image recognition. The subject may show the medication to theimaging device of the inventive apparatus which then authenticates themedication if in the correct dosage and offer administrationinstructions. Other types of recognition of the bottles may also beused, including RFID tags, bar code reading, text recognition, or otherconfirmation through a provided graphical user interface, preferably inconjunction with the image recognition. Once the medication type andquantity has been authenticated, the apparatus if the invention recordsor otherwise visually analyzes the patient actually administering themedication to him or herself, using any of the above recognitionmethods, and further including facial recognition, badge identification,or any other method for confirming the identity of the individual. Areal-time log for audit trails and further analysis is thereby created.Additional information may be captured using a brief questionnaire onthe device which may help to highlight problems when administering themedication—such as difficulty in swallowing tablets or openingpackages—or adverse reactions from which the patient is suffering.Whatever the reason a patient misses a reminder or medication prompt,the system and method of the invention alerts the clinical trialorganizers. Data from all the population can be captured and presentedin an aggregated manner online in real-time, giving real-time dataresults and flag problems or results early.

It is therefore contemplated that the apparatus in accordance with thepresent invention be applicable to settings including clinical trials,as well as in more general healthcare settings, such as whith home careprovided by a healthcare assistant, or self administered by a patient,in a hospital or other clinic setting, or in other locations wheremedication management would be beneficial. The ability for the apparatusconstructed in accordance with the invention to capture patient andmedication administration data in a more controlled environment willallow for more consistent data to be gathered, thus easing the burden ofinsuring adherence to one or more prescribed medication administrationregimens.

Furthermore, while the apparatus constructed in accordance with theapplication has been described as implementing a method and system asdescribed in one or more other pending U.S. patent applications, it isintended that the apparatus be available as a standalone apparatus, foruse and implementation in systems other than those described inaccordance with this or other noted patent applications.

Still other objects and advantages of the invention will in part beobvious and will in part be apparent from the specification anddrawings.

The invention accordingly comprises the several steps and the relationof one or more of such steps with respect to each of the others, and theapparatus embodying features of construction, combinations of elementsand arrangement of parts that are adapted to affect such steps, all asexemplified in the following detailed disclosure, and the scope of theinvention will be indicated in the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the invention, reference is made tothe following description and accompanying drawings, in which:

FIG. 1 is a block diagram depicting an embodiment of the invention;

FIG. 2 is a block diagram depicting details of systems associated withan embodiment of the invention;

FIG. 3 is a flow chart diagram depicting a method in accordance with anembodiment of the invention; and

FIG. 4 is a flow chart diagram depicting a method in accordance with anembodiment of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Referring first to FIG. 1, a remote information capture apparatus 100 isshown. Such apparatus is adapted to allow for the capture and processingof information in order to implement the system and method in accordancewith the applications noted above and incorporated herein by reference.Such information capture apparatus 100 is placed in communication with aremote data and computing location 300 via a communication system 200,preferably the Internet or other communication system. Via communicationsystem 200, information captured by apparatus 100 is transmitted toremote data and computing location 300, and analysis information orother instructions may be provided from remote data and computinglocation 300 to apparatus 100. It is further contemplated that aplurality such information capture apparatuses 100 may be coordinated tomonitor a larger space than a space that can be covered by a single suchapparatus. Thus, the apparatuses can be made aware of the presence ofthe other apparatuses, and may operate by transmitting all informationto one of the apparatuses 100, or these apparatuses may eachindependently communicate with remote data and computing location, whichis adapted to piece together the various information received from theplurality of devices 100.

Referring next to FIG. 2, a more detailed view of a preferred embodimentof remote information capture apparatus 100 and remote data andcomputing location 300. As is shown in FIG. 2, apparatus 100 comprisesan information capture device 110 for capturing video and audio data asdesired. A motion detector 115 or other appropriate trigger device maybe provided associated with capture device 110 to allow for theinitiation and completion of data capture. Information capture device110 may comprise a visual data capture device, or may be provided withan infrared, night vision, or other appropriate information capturedevice. A storage location 120 is further provided for storing capturedinformation, and a processor 130 is provided to control such capture andstorage, as well as other functions associated with the operation ofremote information capture apparatus 100. An analysis module 135 isprovided in accordance with processor 130 to perform a portion ofanalysis of any captured information at the remote information captureapparatus 100. Apparatus 100 is further provided with a display 140, anda data transmission and receipt system 150 and 160 for displayinginformation, and for communicating with remote data and computinglocation 300. Remote data and computing location 300 comprises systemmanagement functions 330, and a transmission and reception system 350and 360 for communicating with apparatus 100. Such system managementfunctions comprise, at least in part, many of the centralized functionsnoted in the three pending patent applications noted above andpreviously incorporated herein by reference. Transmission and receptionsystem 350 and 360 may further comprise various GPS modules so that alocation of the device can be determined at any time, and may furtherallow for a message to be sent to one or more individual apparatuses,broadcast to all apparatuses in a particular trial, or being used foradministration of a particular prescription regimen, of broadcast to allavailable apparatuses.

In accordance with the invention, apparatus 100 is adapted to be part ofa system that improves adherence to medical protocol in both a clinicaltrial and other medication administration setting. Users of apparatus100 in accordance with this system give administrators a tangible andconcrete manner in which to confirm compliance or lack thereof, and theability to intervene early in the process to ensure that patientsenrolled in such a clinical trial study are properly taking theirmedication. Apparatus 100 of the invention is adapted to receiveinstructions for patients from remote data and computing location 300and provide these instructions to patients on the use of theprescription medication. Such instructions may comprise written, audioor audio visual instructions for guiding a user to adhere with aprescribed protocol. Apparatus 100 further provides verification to adoctor or other service provider of patient adherence to the prescribedprotocol, and statistical and individual analysis of adherence rates toensure proper medication administration.

Referring next to FIG. 3, a data flow overview on accordance with theoperation of apparatus 100 is shown. In accordance with the invention,information about a particular drug to be the subject of a clinicaltrial or other medication administration program or prescription isprovided in a database 405, and existing industry medication informationdatabases 410 are employed to access prescription, interaction,application and other available information about any number of proposedprescription and non-prescription medications and their possibleinteraction with the clinical trial medication. Further, patient medicalrecords 415 are used, and as will be described below, are used inconjunction with the industry medical information and a medicalprofessional's prescribing expertise to confirm that a patient is a goodcandidate for such a clinical trial. These databases may be accessed viaapparatus 100, or from remote data and computing location 300. Onceconfirmed, a medicine regimen in accordance with the clinical trial orother prescription requirements is prescribed and entered into thesystem of the invention at 420. Once entered into the system, aparticular prescription regimen causes a set of user instructions 425 tobe generated and transmitted to apparatus 100. In a clinical trialsetting, such instructions may be varied for different users todetermine the best set of instructions, or may be varied based upondemographics, experience, or other factors that may require differenttypes of instructions to be provided. It is further contemplated inaccordance with the invention that multiple clinical trials or patientpopulations may be managed by a manager in accordance with the inventionso that the invention contemplates a medication administration systemthat allows for a single point of management for all clinical trials orpatient management groups associated with a particular manager or thelike.

Such user instructions may include general instructions about theparticular medication subject to the current trial or medicationadministration protocol, methods for ingestion, warnings about sideeffects, concerns about drug interactions with common substances ormedications, or other medications prescribed to the patient by thesystem or by another medical service provider. It is contemplated inaccordance with the invention that such set of user instructions may beinteractive, allowing a user to view additional information about suchinstructions or prescriptions as desired. These instructions maycomprise written, audio or video instructions provided to the user ondisplay 140 of apparatus 100. Furthermore, it is contemplated inaccordance with the invention that at various points during theinstruction set, for example when a patient asks a particular type ofquestion, or asks to receive additional information about a particularaspect of the medication or prescription regimen through entry ofinformation into apparatus 100, that apparatus 100 may reach out andcontact a representative of a medical service provider via thetransmission and reception systems 150 and 160 to provide the patientwith additional, personal help as necessary, if it is determined thatsuch intervention by the medical professional would be desirable to thepatient. Thus, such a patient may be assisted in properly takingmedication so that various errors do not take place. Indeed, in moretraditional scenarios, it is only after perhaps finishing a prescriptionregimen and a return to a doctor in accordance with a predeterminedclinical trial schedule that it is discovered that the medication mayhave been taken incorrectly. In accordance with the present invention,early intervention with such issues can be exercised to deter anypossible unfortunate outcomes from improper administration ofmedication, and to ensure that the particular patient is able to remainin the study and provide accurate data to the study.

It is contemplated in accordance with the invention that a touch orother user friendly graphical user interface be provided associated withapparatus 100 so that the user can easily manipulate any number ofprescription factors, and perhaps enter additional information that maybe useful to a prescribing medical provider, such as level of fatigue,level of hunger, jitter inducing medications, etc. All of these datacollection points allow for a smoother administration of medication to apatient, and therefore a more likely chance of adherence to a prescribedprotocol.

Referring to the lower portion of FIG. 3, the horizontal line indicatesa time for patient ingestion or other administration of medication. Thepatient may display a medication container and/or an actual pill orother medication form to imaging capture device 110 of apparatus 100 atstep 430, which in turn may perform local processing and analysis viaprocessor 130 and associated analysis module 135. Apparatus 100 confirmsthat the medication is correct and is the currently prescribedmedication to be taken through the use of text recognition, pillrecognition, or other appropriate medication recognition scheme. Thissequence of steps therefore acts as an audit trail each time amedication is taken, that can be reviewed later, to ensure that apatient is properly following a regimen.

In accordance with the invention, confirmation of patient adherence tothe prescribed administration schedule for the medication as prescribedby the clinical trial or other prescription regimen is determined. Whilesuch confirmation may take a number of forms, in accordance with theinvention, a preferred method for such confirmation may includecapturing a video sequence of the patient actually administering themedication by apparatus 100. In a further preferred method, such asequence for such confirmation may include employing a facialrecognition sequence or other biometric confirmation that a particularpatient is in fact receiving treatment, but may also provide for theability to obscure the face or other identifying feature of a user toallow for the storage and use of such images while protecting theidentity of the patient, a technique that may be beneficial when amanager is providing a general report about the clinical trial, and nottrying to remedy a situation with a particular patient. Activityrecognition, gesture recognition or other feature for determiningwhether a particular subject movement meets a predefined movementsequence may be employed to be sure that the patient is properly takingprescribed medication.

Furthermore, in accordance with the present invention, a video image ofthe patient actually administering or ingesting the medication may betaken in accordance with apparatus 100 and stored in memory 120 so thatactual confirmation may be achieved, rather than simply relying on thepatient to state that a particular medication was administered. Such avideo image may be captured or stored in any appropriate format given aselected type of activity or gesture recognition that is employed inaccordance with a particular embodiment of the invention. Such mayinclude full video, biometric data points, recording of movement of anarticle, such as a bracelet or the like, affixed to the patient oradministrator, use of mapping to provide a stick figure or other bodymovement tracking technique, or gesture or activity recognition todetermine movement or the like. The user may be encouraged to use aparticular sequence of movement to be confirmed that they are properlyadministering the medication according to the protocol, thus reducingthe possibility of the potential appropriate movements considered to be“correct.” Indeed, various instructional videos or other appropriatetraining may be provided to a user to insure they properly administerthe medication. Finally, in accordance with the invention, if recordingof a video of a patient having the medication administered thereto isnot possible, the system of the invention will recognize such an issueand request audio confirmation via apparatus 100 as a next best option.If the audio confirmation is also not possible, then a less reliablemethod of confirmation, such as a keyboard confirmation by the patientmay be accepted. If higher reliability methods of confirmation are notavailable for an extended period of time, an alarm is preferablyforwarded to a medical professional to inquire as to reasons and toremedy any situation that might be wrong in the administrationsituation.

These steps of confirming identity, confirming medication and confirmingadministration are then reviewed to verify adherence to the prescribedprotocol at 435. Such review is preferably performed automatically firstby processor 130 and analysis component 135 thereof that is able toalign the actual recorded images with ideal or expected images, orthrough the use of other activity or gesture recognition as mentionedabove. In the case of facial recognition and bottle or pill recognition,such techniques are known in the art. With regard to video confirmationof adherence to prescribed medicine administration procedures, suchprocessing may include various stick figure comparison analyses,activity recognition analysis, or other schemes as noted above able todetermine whether appropriate actions have been performed by thepatient.

The ability to provide automated determination of adherence to properadministration procedures at the apparatus 100 allows for a first, quickreview of any such images to determine whether any immediate attentionmay be warranted. As will be described below, further review at remotedata and computing location 300 allows for a large number of such imagesto be reviewed in a short period of time. Even if actual and completelack of adherence is not able to be determined 100% in each possiblesituation, the ability to pre screen the administration video capturesto remove from further consideration administration situations that areclearly compliant may reduce a number of compliance situations to bereviewed by a medical professional substantially. Additional humanreview of indications of failure of adherence may be provided, thusinsuring proper review of all potentially dangerous situations whilegreatly reducing the number of images necessary to be reviewed by ahuman. Thus, multiple benefits of such an automated system are realized,including reducing time to review such images, reducing costs of suchreview, and improving patient privacy by limiting the number of humansviewing such data, while improving quality.

In an additional embodiment of the invention the imaged sequences usedfor activity recognition to determine regimen adherence may be furtherused to check for adverse or other reactions to taking of themedication. Thus, in addition to simply determining proper adherence toa protocol at apparatus 100, such activity or gesture recognition maydetermine any number of different actions that may have been taken by apatient. Thus, actions taken before medication administration, oractions taken after medication administration may give insight intoreasons for particular responses, etc. Thus, before administration, inaccordance with the invention, activity recognition may determine acurrent activity of a user. Any subsequent reminders to take amedication may in part be based upon this determined activity. By way ofexample, if a user is putting on a coat, or is determined to be leavinga residence or other facility or the like, a reminder to take amedication before leaving may be provided, even if earlier than normal,or if medication is portable, the user may be reminded to take themedication with them, and then subsequently reminded to administer themedication via notification on a mobile device. By way of furtherexample, if the user is cooking, a reminder may be given to take themedication a predetermined time before eating. Other scenarios may bepossible, thus allowing greater response from the system to ensureproper medication administration by a patient. Additionally, variouspatient consent issues may be prompted and recorded in accordance withthe invention. Patients may ask further additional questions regardingsuch consent, thus insuring that patients have all of the informationthey need to make informed consent decisions, and medication providershave proper evidence of such consent.

Similarly, actions after taking medication may give insight into patientresponses. Notice of fainting, falling down, lack of motion, facialgestures, gastrointestinal distress or the like may all be logged asadverse reactions to a particular medication regimen, and may allow foradjustment of dosage or prescription instructions in the future for thepatient. If adverse reactions are severe, an immediate medication reviewand contact from a medical professional may be provided to cure theissue. Additionally, the system in accordance with the present inventionmay be directly tied and be interoperable with a pharmacy or medicalprovider's systems as administered by the clinical trial manager, thusallowing such recommendations for dosage changes, regimen changes andthe like to be forwarded to these professionals automatically. Throughsuch links, reordering medication, dosage changes, medication changesand the like may be automatically provided. Furthermore, ease ofproviding additional prescriptions can be enhanced as patient,medication and regimen information will already be available to thepharmacist or medical service provider.

After such automatic, or combination of automatic and manual, adherenceverification is performed allowing a health care provider or othermedical professional to review and verify results of the automaticcomparison or direct review of captured activity sequences, andindication of variation from a desired identity, medication orapplication procedure may request administrator review of the situation,and intervention as may be determined necessary at 440. Such review maybe required immediately as an emergency situation may exist, or thepatient may gesture or otherwise indicate that help is necessary, orsuch review may be less urgent, perhaps requiring an electroniccommunication with suggestions or the like from such an administrator orthe like. Additionally, such adherence review may be stored over timefor a particular patient, thus allowing for various medication trends tobe determined, such as if a patient misses medication at a same timeeach week, or an indication that one particular health care workeraiding the patient may occasionally give an incorrect medication dosageamount. Thus, in addition to allowing for immediate notice of problemsin medication administration, an audit trail for tracking the actions ofvarious health care providers is generated. Such an audit trail allowsclinical trial administrators or other medical professional to determineimmediately, or upon review of a complete medication regimen, whether aparticular patient or group of patients has followed the protocol to thelevel that allows their results to be used as part of the study.Additionally, levels of adherence may give insight as to the ease of useof a particular regimen, and whether instructions provided to thepatient are sufficient to allow for adherence to the prescribedmedication regimen.

Referring next to FIG. 4, a user implementation of the method inaccordance with the invention will be described. When a time forreceiving or administering a medication in accordance with a clinicaltrial regimen is reached, a patient, and any other necessary user may beprovided a notification 510 from apparatus 100. Thus, in a homesituation, only the patient may receive notification. If there is a homehealth care provider, such provider may also receive separateindependent verification. In the case of hospital or other in-patientcare facility, various medical service providers may similarly receivesuch notification. After notification, or in the absence of suchnotification, system initiation preferably takes place at 515. Inaccordance with such system initiation, one or more users are preferablyrecognized by the system. Therefore, at step 520, a user recognitionsequence may be employed. In a preferred embodiment, such a user has astill or video image captured of their face by apparatus 100, and facialrecognition techniques are employed to confirm the identity of the userin analysis module 135. Alternative recognition techniques, such asretinal, fingerprint, voice or other biometric measurements may beemployed, in addition to a more common password query. Any otherappropriate identification technique may be employed, and any uniqueindividual identifiers may be obscured, as noted above, when the imagesare to be used as a more general report regarding adherence, rather thanan individual patient response.

At step 525 it is determined whether all necessary users have beenrecognized and authenticated. In a situation where a nurse, doctor orother caregiver is to administer medication, it may be preferable tohave the patient and caregiver to be recognized by the system to furtherconfirm that the appropriate procedure is followed, and to allow thesystem to keep track of people using the medication so it can track ifany one person, for example, is improperly using the medication, as willbe evident from the generated audit trail. After step 525, if all usersare not recognized, control passes back to step 520 and any additionalusers are recognized by the system.

Once all users are recognized, control passes to step 527 where themedication to be administered in accordance with the prescribedprescription regimen of the clinical trial is confirmed. Thus, a user isprompted by apparatus 100 to allow a still or video image, textrecognition image, or other method of identifying a medication to becaptured of the medication bottle or other container, a pill of themedication, or other form of medication, and is also able to determineappropriate quantities, dosage, and any potentially required ordangerous medication combinations. As noted above, if video confirmationis for some reason not available, the user may be prompted by the systemto provide audio or other indication of medication and other desiredinformation. This image, video sequence or other received confirmationinformation is then compared to an image associated with a prescribedprescription. If the medication is determined to be incorrect afteranalysis by analysis module 135, a warning may be provided fromapparatus 100 to the user that the medication is incorrect. The user maythen be prompted to choose another medication for imaging.

Alternatively, the invention contemplates a user displaying a number ofmedications to apparatus 100 and allowing the apparatus to suggest whichmedication is correct. Thus, the user may be able to scan a medicinecabinet with such a video imaging apparatus and have the system indicatewhich the correct medication is. This may prove valuable when sequenceof ingesting medication is important, or when two people have similarmedications and may have difficulty in distinguishing betweenmedications for each. Once a correct medication has been identified,control passes to step 530.

In step 530 user prompts and other instructions are provided to thepatient from apparatus 100, and present caregivers, as to how toadminister the medication according to the prescription guidelinesoutlined above as determined in accordance with the particular clinicaltrial under consideration. These instructions allow for a user toreceive further information or instructions as necessary through askingthe system for additional help. Especially in situations where anelaborate scheme may be required, it is contemplated that video samplesand instructions may be provided to the user. Further, in accordancewith the invention, for complicated administration procedures, it may bepossible to set up a two way video conference employing traditionalvideo conferencing, VOIP conferencing, traditional telephoneconferencing, or any other appropriate communication system with anexpert in such administration so that a caregiver or patient may receivelive coaching regarding such administration, all via apparatus 100,perhaps with additional features and elements provided to allow for suchadditional functionality. Such instructions and prompts may bedetermined by the medication manager to determine the success or failureof particular sets of instructions. Thus, not only may medicationstested in a clinical trial, but also sets of instructions are tested todetermine which are best for all, or for giver demographic groups or thelike for eventual user when the medication is released to the public,thereby allowing for a better adherence rate by the public. As thenumber of clinical trials and other patient populations grows, and thelocations of such trials groups become more international, suchadministration through a system such as that set forth in accordancewith the invention may become far more important to various medicationadministration managers.

When following such instruction prompts, the actual act ofadministration is preferably captured as a video sequence at step 535 byapparatus 100 via capture device 110 and stored to storage 120.Administration preferably includes one or more identifiable gestures assuggested in accordance with the instructions above. A patient oradministrator may be provided with one or more images or sequences formethod of application or administration, and thus the following of thesesequences is used to determine compliance with a particular prescribedregimen. Further, long gaps or pauses may be determined to give furtherinsight into areas of administration that may be giving problems toadministrators of trial participants. This captured video sequence maybe utilized in accordance with the invention in a number of ways. First,the actions of administration of the medication is reviewed in real timeand compared to an ideal or desired video sequence by processor 130 andanalysis module 135. If a determination is made that the medication isbeing administered in an incorrect manner, and in a way that may bedetrimental to the patient, immediate warnings may be provided at step540 via apparatus 100 advising the caregiver or patient to stopadministration at once. Furthermore, in extreme cases, a doctor or othercaregiver may be notified, or in the most dangerous cases, an ambulanceor other emergency personnel may be dispatched to provide immediatecare.

Notification may also be provided to the clinical trial manager or othermedication administrator so that this person is warned that one or morepatients are having problems with adherence with the protocol. If suchproblems turn out to be isolated, alternative instructions, or personalhelp may remedy the situation, thus allowing the person to providemeaningful data to the trial. If such lack of adherence is far morewidespread, a clinical trial manager or other medication administratormay change instructions for all participants, or may even ask allparticipants to come back in for further live instructions. In eithersituation, the cost of administration is greatly reduced as participantsare able to remain in a study, and major failures of studies for lack ofprotocol adherence may be avoided. Reports based upon such widespreadlack of adherence may provide a manager with a report, using images orthe like with identifying features removed so that the report may showprecisely how a medication is being administered while maintainingpatient privacy and confidentiality. If video recording is notavailable, other confirmation methods as noted above may be employed andbe subject to automatic confirmation as with the video recordedsequences.

If such immediate care or warning is not required, control then passesto step 545 where the video images are more formally captured,transmitted to remote data and computing location 300 and analyzed forvarious other non-critical issues. The images may be captured and storedlocally, being provided to a central server in a batch processing, orimages may be captured and sent to the remote server location 300 forimmediate analysis and storage. Such analysis may consider suggestionsto a caregiver to improve dosage accuracy, reduce pain inadministration, or the like. Furthermore, as such video sequences may beavailable from multiple patients and/or caregivers taking part in acurrent or multiple clinical trials, the effectiveness of various setsof instructions and the like can be tested and reviewed, and changesthereto made if consistent problems are encountered. This type of studyis nearly impossible without the present invention, because in any typeof clinical setting, individuals are far more likely to be careful inadministration of medication, and therefore not cause errors. When theyreturn home or back to their regular lives, this is when adherence andadministration issues arise. In accordance with the invention, responsesto instructions can be analyzed, and lack of adherence based uponconfusing or difficult to follow instructions can be remedied, providingbetter or more usable instructions, and therefore improving regimenadherence. Without the present invention, such a clinical trial managermay be unaware of such issues. With the invention, these issues can beaddressed as they arise, thus ensuring the integrity of the clinicaltrial.

In any event, after such analysis, any warnings or suggestions forinstruction issues may generate a warning at step 550, suggesting areasof instruction that may be problematic. These video sequences are alsostored for longer term analysis if desired at step 555, and processingends. Furthermore, in order to encourage patients in the clinical trial,notices of lack of adherence may be used to change remuneration receivedby a patient in the clinical trial. Thus, adherence to the protocolresults in higher payments to the patient, a great incentive for thepatient to adhere to the protocol.

Trends of a patient taking part in the clinical trial or othermedication administration program can be monitored by apparatus 100 inaccordance with the provision of additional diagnostic attachments, suchas blood pressure or other measurable quantities of the patient, andcorrelation between such measured quantities and medicationadministration may be observed, potentially allowing for a morecustomized solution of medication to be applied to the patient, possiblemodifying dosage or frequency of administration based upon individualreactions to a particular prescription regimen. Additionally, featuresof the invention noted above allowing for user interaction andrecordation of activities of a user, adverse effects and the like may beincorporated into the system to provide further information fordetermining alternative instruction sets, modification of medicationsand the like.

Thus, provision of such an apparatus 100 increases effectiveness andallows for better control over medication administration. Difficultiesin following protocols may be determined in near real time. Changes in amedication protocol may be easily implemented and conveyed to patientsand their prescribing doctors. New training modules, including video,written, or other instructions may be provided improve adherence.Inventory management is eased and all patients are sure to have theappropriate amounts of medication and other supplies. The system andapparatus 100 can be used by a single medical provider, doctor group ornetwork, insurance company, governmental agency, nursing home, hospice,home care provider or the like, or other group in order to track anynumber of patients and associated home care workers, doctors, or othermedication administrators.

All communications in accordance with the invention are preferablyencrypted or otherwise protected during transmission and storage at bothlocal and remote mass storage location to meet any security issues andany regulations required for the storage and maintenance of medical andpatient health care information.

Alternative embodiments of the invention may provide one or more of thefollowing additional features. Rather than simply providing a videocapture in a traditional sense, apparatus 100 may be provided with nightvision, infrared vision, or other desired capture scheme. Apparatus 100is also contemplated to be provided with a number of apparatusmanagement features, including an ability to choose between color andblack and white video storage and transmission, auto focus on a patientor the like, and including tracking of such an individual as they moveabout a room, the ability to strip any identifying information fromtransmitted video so that anonymity can be maintained, if desired.Apparatus 100 may include mechanisms to indicate a need for recharging,and include sleep modes for extending battery life. It is furthercontemplated that apparatus 100 may act as a monitoring device for apatient, and in a standby mode the apparatus may “listen” or “look” forsounds from the patient, including suggestions of a fall, scream or thelike. Automated responses may be provided in order to access patientstatus via integrated speakers or the like. The transmission system ofapparatus 100 may then notify appropriate personnel. Thus, theportability and multiple use areas provide an additional benefit to theuser of this apparatus.

Therefore, in accordance with the invention, a method and apparatus areprovided that allow for the automated confirmation of adherence toadministration protocol for medication, and provide for a mostsophisticated method for confirming and studying methods ofadministration of such prescription medication.

It will thus be seen that the objects set forth above, among those madeapparent from the preceding description, are efficiently attained and,because certain changes may be made in carrying out the above method andin the construction(s) set forth without departing from the spirit andscope of the invention, it is intended that all matter contained in theabove description and shown in the accompanying drawings shall beinterpreted as illustrative and not in a limiting sense.

It is also to be understood that this description is intended to coverall of the generic and specific features of the invention hereindescribed and all statements of the scope of the invention which, as amatter of language, might be said to fall there between.

What is claimed:
 1. A medication adherence monitoring system,comprising: a first storage device operable to store (i) one or moresets of video instructions and user prompts for encouraging properperformance of one or more predetermined movement sequences to beperformed by a patient and (ii) additional video data comprising one ormore videos of the one or more predetermined movement sequences, the oneor more predetermined movement sequences being indicative of propermedication administration; a display operable to display to the patient,one or more of the one or more sets of video instructions and userprompts for encouraging proper performance of the one or morepredetermined movement sequences; a video data capture device operableto capture at least video data of the patient performing one or more ofthe one or more predetermined movement sequences in response to the oneor more of the one or more video instructions and user prompts; a secondstorage device for storing the captured video data; and a firstprocessor operable to output, to the display, a first type of alert thatnotifies the patient it is time to administer medication, receive apatient medication administration initiation response following theoutput of the first type of alert, output to the display, responsive toreceiving the patient medication administration initiation response, theone or more of the one or more sets of video instructions and userprompts for encouraging proper performance of the one or morepredetermined movement sequences, receive the captured video data fromthe second storage device, automatically compare the stored capturedvideo data to the additional video data comprising the one or morevideos of the one or more predetermined movement sequences, determine,from the comparison, whether the patient has properly performed thepredetermined movement sequences, responsive to determining, from thecomparison, that the patient has not properly performed thepredetermined movement sequences, output, to the display, interactivefeedback to the patient and an additional one or more of the one or moresets of video instructions and user prompts to further encourage properperformance of the one or more predetermined movement sequences.
 2. Thesystem of claim 1, further comprising a transmission system fortransmitting the captured video data to a storage and analysis locationthat includes the first and second storage devices, and the firstprocessor and that is remote from the video data capture device.
 3. Thesystem of claim 1, wherein the first processor is operable to, inresponse to the comparison of the stored captured video data to theadditional video data, determine whether an immediate first response tothe patient would be proper, and subsequent to determining that animmediate first response to the patient would be proper, output to thedisplay a second type of alert.
 4. The system of claim 3, furthercomprising: a storage and analysis location that includes a secondprocessor and that is remote from the video data capture device; and atransmission system for transmitting the captured video data to thestorage and analysis location, wherein the second processor is operableto recognize and analyze medication administration including medicationingestion by the patient from the captured video data, and wherein thesecond processor is operable to, in response to analyzing the receivedvideo data, determine whether a second supplemental response to apatient would be proper.
 5. The system of claim 4, wherein the secondprocessor is operable to transmit, by the transmission system, thesecond supplemental response from the storage and analysis location tothe display.
 6. The system of claim 1, further comprising: atransmission system operable to transmit the captured video data to astorage and analysis location that is remote from the video capturedevice; and a receipt system operable to receive medication adherenceresponse information from the storage and analysis location.
 7. Thesystem of claim 1, wherein the one or more predetermined movementsequences comprises an activity associated with administration of aprescription protocol.
 8. A medication adherence monitoring system foruse in confirming administration of medication in a clinical trial,comprising: a first storage device operable to store one or more sets ofvideo instructions and user prompts for encouraging proper performanceof one or more predetermined movement sequences to be performed by aparticipant, the one or more predetermined movement sequences beingindicative of proper performance of a predefined participant clinicaltrial protocol for medication administration; a display operable todisplay to the participant one or more of the one or more sets of videoinstructions and user prompts for encouraging proper performance of theone or more predetermined movement sequences; a video data capturedevice operable to capture at least video information of the participantperforming one or more of the one or more predetermined movementsequences following the one or more of the one or more displayed videoinstructions and user prompts; a second storage device for storing thecaptured video information; a first processor operable to output, to thedisplay, a first type of alert that notifies the participant it is timeto administer medication, receive a participant medicationadministration initiation response following the output of the firsttype of alert, output to the display, responsive to receiving theparticipant medication administration initiation response, the one ormore of the one or more sets of video instructions and user prompts forencouraging proper performance of the one or more predetermined movementsequences, receive the stored captured video information from the secondstorage device, automatically analyze the stored captured videoinformation to determine whether the participant has properly performedthe predetermined movement sequences, confirm, from the automaticanalysis, whether the participant properly performed the predeterminedmovement sequences, responsive to determining, from the comparison, thatthe participant has not properly performed the predetermined movementsequences, output, to the display, interactive feedback to theparticipant and an additional one or more of the one or more sets ofvideo instructions and user prompts to further encourage properperformance of the one or more predetermined movement sequences.
 9. Thesystem of claim 8, wherein the predefined participant clinical trialprotocol is provided by a clinical trial manager.
 10. The system ofclaim 8, comprising a medical database stored on the first or secondstorage device, wherein the predefined participant clinical trialprotocol are stored in the medical database.
 11. The system of claim 8,further comprising: a second processor at a storage and analysislocation that is remote from the video data capture device; atransmission system operable to transmit at least a portion of thecaptured video information to the remote storage and analysis location;and a receipt system operable to receive medication adherence reportinformation from the remote storage and analysis location, wherein thesecond processor is adapted to perform a statistical analysis of thecaptured video information.
 12. The system of claim 8, wherein the firstprocessor is further adapted to: retrieve medical history information ofthe participant; determine whether a to be administered medication inthe clinical trial is safe for the participant; and output a warning,when the first processor determines that the to be administeredmedication is not safe for the participant or that the to beadministered medication is not recognized.
 13. The system of claim 12,wherein the first processor is operable to output additionalinstructions to a medication administrator when the first processordetermines that the to be administered medication is not safe for theparticipant.
 14. The system of claim 12, wherein the warning comprisesadditional instructions to a patient receiving the medication accordingto the predefined participant clinical trial protocol.
 15. The system ofclaim 8, wherein the medication adherence monitoring system is operableto provide live contact with a clinical trial manager through audioand/or video communication.
 16. A system for confirming administrationof medication, the system comprising: an authentication apparatus forauthenticating a medication manager; a database comprising prescriptionadministration information for the medication; and a medicationadherence monitoring apparatus, the medication adherence monitoringapparatus comprising a first storage device operable to store (i) one ormore sets of video instructions and user prompts for encouraging properperformance of one or more predefined movement sequences to be performedby a patient and (ii) additional video data comprising one or morevideos of the one or more predetermined movement sequences, the one ormore predefined movement sequences being indicative of proper medicationadministration; a display operable to display to the patient one or moreof the one or more sets of video instructions and user prompts forencouraging proper performance of the one or more predefined movementsequences; a video data capture device operable to capture at leastvideo data of the patient performing one or more of the one or morepredefined movement sequences following the one or more of the one ormore displayed video instructions and user prompts; a second storagedevice for storing the captured video data; and a first processoroperable to output, to the display, a first type of alert that notifiesthe patient it is time to administer medication, receive a patientmedication administration initiation response following the output ofthe first type of alert, output, to the display, responsive to receivingthe patient medication administration response, the one or more of theone or more sets of video instructions and user prompts for encouragingproper performance of the one or more predetermined movement sequences,receive the stored captured video data from the second storage device,automatically compare the stored captured video data to the additionalvideo data comprising the one or more videos of the one or morepredefined movement sequences, determine, from the comparison, whetherthe patient has properly performed the predefined movement sequences,responsive to determining, from the comparison, that the patient has notproperly performed the predefined movement sequences, output, to thedisplay, an immediate notice to the patient that medicationadministration is not recognized and an additional one or more of theone or more sets of video instructions and user prompts to furtherencourage proper performance of the one or more predetermined movementsequences.
 17. The system of claim 16, wherein the additional one ormore sets of video instructions comprise real time interactive feedbackto aid the patient in properly administering the medication during acurrent medication administration.